Control-Variate Estimation Using Estimated Control Means
نویسندگان
چکیده
We study control variate estimation where the control mean itself is estimated. Control variate estimation in simulation experiments can significantly increase sampling efficiency, and has traditionally been restricted to cases where the control has a known mean. In a previous paper (Schmeiser, Taaffe, and Wang 2000), we generalized the idea of control variate estimation to the case where the control mean is only approximated. The result is a biased, but possibly useful estimator. For that case we provided a mean-square-error optimal estimator and discussed its properties. In this paper we also generalize classical control variate estimation to the case of control variates using estimated control means (CVEMs). CVEMs replace the control mean with an estimated value for the control mean, obtained from a prior simulation experiment. Although the resulting control-variate estimator is unbiased, it does introduce additional sampling error and so its properties are not the same as those of the standard control-variate estimator. We develop a CVEM estimator that minimizes the overall estimator variance. Both biased control variates (BCVs) and CVEMs can be used to improve the efficiency of stochastic simulation experiments. Their main appeal is that the restriction of having to know (deterministically) the exact value of the control mean is eliminated; thus the space of possible controls is greatly increased.
منابع مشابه
Variance Reduction for Stochastic Gradient Optimization
Stochastic gradient optimization is a class of widely used algorithms for training machine learning models. To optimize an objective, it uses the noisy gradient computed from the random data samples instead of the true gradient computed from the entire dataset. However, when the variance of the noisy gradient is large, the algorithm might spend much time bouncing around, leading to slower conve...
متن کاملMultilevel Monte Carlo and control-variate simulation of Coulomb collisions
The multilevel Monte Carlo and the control-variate method are reviewed for simulation of Coulomb collisions. The test case considered is fast-ion relaxation from ion-ion and electron-ion collisions against a Maxwellian background. A simplified energy scattering model is derived and related to the Cox-Ingersoll-Ross model for which, an exact time dependent solution can be obtained. The exact mod...
متن کاملApplication of the control variate technique to estimation of total sensitivity indices
Global sensitivity analysis is widely used in many areas of science, biology, sociology and policy planning. The variance-based methods also known as Sobol' sensitivity indices has become the method of choice among practitioners due to its efficiency and ease of interpretation. For complex practical problems, estimation of Sobol' sensitivity indices generally requires a large number of function...
متن کاملNew control variates for Lévy process models
We present a general control variate method for Monte Carlo estimation of the expectations of the functionals of Lévy processes. It is based on fast numerical inversion of the cumulative distribution functions and exploits the strong correlation between the increments of the original process and Brownian motion. In the suggested control variate framework, a similar functional of Brownian motion...
متن کاملEstimation of means and covariances of inverse-Gaussian order statistics
We propose a simulation algorithm to estimate means, variances, and covariances for a set of order statistics from inverse-Gaussian (IG) distributions. Given a set of Monte Carlo data, the algorithm estimates these values simultaneously. Two types of control variates are used: internal uniform and external exponential. Simulation results show that exponential control variates work better, best ...
متن کامل